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Abstract — Our purpose in this paper is to obtain the exact 
distribution of the number of buffer starvations within a sequence 
of N consecutive packet arrivals. The buffer is modeled as an 
M/M/l queue. When the buffer is empty, the service restarts 
after a certain amount of packets are prefetched. With this goal, 
we propose two approaches, one of which is based on Ballot 
theorem, and the other uses recursive equations. The Ballot 
theorem approach gives an explicit solution, but at the cost of the 
high complexity order in certain circumstances. The recursive 
approach, though not offering an explicit result, needs fewer 
computations. We further propose a fluid analysis of starvation 
probability on the file level, given the distribution of file size and 
the traffic intensity. The starvation probabilities of this paper 
have many potential applications. We apply them to optimize 
the quality of experience (QoE) of media streaming service, 
by exploiting the tradeoff between the start-up delay and the 
starvation. 

I. Introduction 

The starvation probability of a buffer is an important per- 
formance measure for protocol design of telecommunication 
networks, as well as in storage systems and ecological systems 
(e.g. dams). Starvation is said to occur when the buffer is 
empty. Various applications use buffering in order to control 
the rate at which packets are served at the destination. As 
long as there are packets in the buffer, packets arrive at the 
destination regularly, i.e. they are spaced by the service time 
of the buffer. Once the buffer empties packets may arrive at the 
destination separated by larger times, as the spacing between 
packets now depends also on the inter-arrival times at the 
queue. Starvation is in particular undesirable in real time voice 
as well as in video streaming applications. 

The time till starvation of a queue is related to the busy 
period which has been well studied under the assumption of 
a stationary arrival process (see 0, and their references). 
In contrast to this assumption, we consider a finite number of 
arrivals as we are interested in statistics of starvation when a 
file of fixed size is transferred. 

The main goal of this paper is to find the distribution of 
the number of starvations within a file of N packets. We first 
model the buffer as an M/M/l queue, and then extend it to 
incorporate the bursty packet arrival that is modeled by an in- 
terrupted Poisson process (IPP). In this system, a fixed amount 
of packets are prefetched (also called "prefetching threshold") 
before the service begins or resumes after a starvation event. 



In this paper, we propose two approaches (that give the same 
result) to compute the starvation probabilities and the distri- 
bution of the number of starvations for a single file. The first 
approach gives an explicit result based on the Ballot theorem 
(TJ. The second approach provides a recursive computation 
algorithm. Both are done in an M/M/l queue on a packet level. 
Using Ballot theorem, we can compute in a simple way the 
exact distribution of the number of starvations explicitly As 
the file size approaches infinity, we present the asymptotic 
starvation probability using Gaussian (interchangeable with 
Normal) approximation as well as an approximation of the 
Riemann integral. Whereas the Ballot Theorem provides an 
explicit solution, we propose an alternative approach which 
constitutes a recursive algorithm for computing starvation 
probabilities. Although the recursive approach does not gener- 
ate an explicit solution, it does perform better than the Ballot 
Theorem in terms of complexity under certain circumstances. 

We further propose a fluid analysis of starvation behavior 
on the file level. This approach, instead of looking into the 
stochastic packet arrivals and departures, predicts the starva- 
tion where the servers manage a large quantity of file transfers. 
Given the traffic intensity and the distribution of file size, we 
are able to compute the starvation probability as a function of 
the prefetching threshold. The fluid analysis, though simple, 
offers an important insight on how to control the probability 
of starvation for many files, instead of for one particular file. 

The probabilities of starvations developed in this work 
have various applications in the different fields. A prominent 
example is the media streaming service. This application 
demonstrates a dilemma between the prefetching process and 
the starvation. A longer prefetching process causes a larger 
start-up delay, while a shorter one might result in starvations. 
The user perceived media quality (or QoE equivalently) is 
impaired by either the large start-up delay or the undesirable 
starvations. This problem becomes increasingly important in 
the epoch that web video hogs up to more than 37% of total 
traffic during peak hours in USA |[T8ll . In contrast to the rapid 
growth of traffic load, the bandwidth provision usually lags 
behind. In this context, media providers and network operators 
face a crucial challenge of maintaining a satisfactory QoE of 
streaming service. With the results developed in this work, 
we are able to answer the fundamental question: How many 
packets should the media player prefetch to optimize the users' 



quality of experience? We propose a set of QoE metrics for 
both the finite and the infinite file size. The optimal QoE 
is achieved by configuring the start-up threshold in packets. 
Recently, the similar QoE issue is studied in the important 
works 0, 0, 0. Liang et al. studies the bounds of start- 
up delay, given the deterministic playout and arrival curves. 
Authors in [7] present a minimum prefetching threshold for 
an M/D/l queue, other than an exact solution. They further 
extend their method to consider the arrival process depicted 
by a two-state Markov chain. Luan et al. adopts diffusion 
approximation to investigate the time-dependent starvation 
behavior. Their technique is inadequate to provide insights 
on starvation in a media file with small number of units 
(in packets or chunks). Compared to state of the art, our 
approaches target at the exact solution, and can analyze the 
starvation of small files. This is particularly important in the 
evaluation of adaptive streaming where the entire media file 
is subdivided into many chunks encoded by multiple playback 
rates. The starvation is more likely to happen when the packets 
from one or several high-definition video chunks are being 
played. 

The rest of this paper is organized as follows. Section [TT] 
reviews the related work. We propose a Ballot approach in 
Section [ill] Section [IV] presents the recursive approach for 
an M/M/l queue. Section [V] performs a fluid analysis for a 
large number of files. Section [Vl]presents the QoE metrics and 
their optimization issues. Our theoretical results are verified in 
section I VIII Section IVIIII concludes this paper and discusses 
the future work. 

II. Related Work 

The analysis of starvation is close to that of busy period in 
transient queues. In 0, authors solve the distribution of 
the buffer size as a function of time for the M/M/l queue. The 
exact result is expressed as an infinite sum of modified Bessel 
functions. The starvation analysis of this work is different from 
the transient queueing analysis in two aspects. First, the former 
aims to find the probability generating function of starvation 
events while not the queue size. Second, the former does not 
assume a stationary arrival process. 

Ballot theorem and recursive equations have been used to 
analyze the packet loss probability in a finite buffer when 
the forward error-correcting technique is deployed. Citon et 
al. propose a recursive approach that enables them to 
compute the packet loss probability in a block of consecu- 
tive packet arrivals into an M/M/l/K queue. Based on their 
recursive approach, Altman and Jean-Marie in [ 1 1 obtain the 
expressions for the multidimensional generating function of 
the packet loss probability. The distribution of message delay 
is given in an extended work [11|. Dubea and Altman in 
1 12 1 analyze the packet loss probability with the consideration 
of random loss in incoming and outgoing links. In fl4l . 
Gurewitz et al. introduce the powerful Ballot theorem to 
find this probability within a block of packet arrivals into 
an M/M/l/K queue. They consider two cases, in which the 
block size is smaller or greater than the buffer limit. Another 
example of applying Ballot theorem to evaluate networking 



system is found in |fl3l . Humblet et al. present a method 
based on Ballot theorem to study the performance of nD/D/1 
queue with periodical arrivals and deterministic service time. 
In fl6l . He and Sohraby use Ballot theorem to find the 
stationary probability distribution in a general class of discrete 
time systems with batch arrivals and departures. Privalov and 
Sohraby [17] study the underflow behavior of CBR traffic in 
a time-slotted queueing system. However, they do not provide 
the insights of having a certain number of starvations. 

In the applications related to our work, Stockhammer et al. 
Ifl311 specify the minimum start-up delay and the minimum 
buffer size for a given video stream and a deterministic 
variable bit rate (VBR) wireless channel. Recently, presents 
a deterministic bound, and [7] provides a stochastic bound 
of start-up delay to avoid starvation. Authors in model 
the playout buffer as a G/G/l queue. By using diffusion ap- 
proximation, they obtain the closed-form starvation probability 
with asymptotically large file size. Xu et.al [21] study the 
scheduling algorithms for multicast streaming in multicarrier 
wireless downlink. In the application field, our paper differs 
from state of the art works in the following ways: i) we present 
new theories that yield an exact probability of starvation, and 
the probability generating function of starvation events; ii) 
we study of asymptotic behavior with error analysis; iii) we 
perform a macroscopic starvation analysis using a fluid model; 
iv) we configure optimal prefetching thresholds to optimize the 
QoE metrics. 

III. Starvation Analysis Using Ballot Theorem 

In this section, we study the starvation behavior of an 
M/M/l queue with finite number of arrivals. The analytical 
method is based on the powerful Ballot theorem. 

A. System Description 

We consider a single media file with finite size N. The 
media content is pre-stored in the media server. When a user 
makes a request, the server segments this media into packets, 
and transfers them to the user by use of TCP or UDP protocols. 
When packets traverse the wired or wireless links, their arrivals 
to the media player of a user are not deterministic due to the 
dynamics of the available bandwidth. The Poisson assumption 
is not the most realistic way to describe packet arrivals, but 
it reveals the essential features of the system, and is the first 
step for more general arrival processes. After the streaming 
packets are received, they are first stored in the playout buffer. 
The interval between two packets that are served is assumed 
to be exponentially distributed so that we can model the 
receiver buffer as an M/M/l queue. The maximum buffer size 
is assumed to be large enough so that the whole file can 
be stored. This simplification is justified by the fact that the 
storage space is usually very large in the receiver side (e.g. 
several GB). 

The user perceived media quality has two measures called 
start-up delay and starvation. As explained earlier, the media 
player wants to avoid the starvation by prefetching packets. 
However, this action might incur a long waiting time. In what 
follows, we reveal the relationship between the start-up delay 
and the starvation behavior, with the consideration of file size. 



B. A Packet Level Model 

We present a packet level model to investigate the starvation 
behavior. Denote by A the Poisson arrival rate of the packets, 
and by p the Poisson service rate. Define p := X/p, as the 
traffic intensity. 

In a non-empty M/M/l queue with everlasting arrivals, the 
rate at which either an arrival or a departure occurs is given by 
A + p. This event corresponds to an arrival with probability p, 
or is otherwise to an end of service with probability q, where 

A p pi 

P A + /i 1 + p ' q A + p 1 + p 

The buffer is initially empty. Let T\ be the start-up delay, 
in which X\ packets are accumulated in the buffer. Once 
the service begins, the probability of starvation is given by 
Theorem Q] 

Theorem 1: For the initial queue length x\ and the total 
size N of a file, the probability of starvation is given by: 



P, = 



N-l 

^ 2k 

k—x\ 



Xi 



2k — X\ 
x\ \ k — x\ 



p k - xi (l-p) k . 



(1) 



Proof: Before proving this theorem, we iterate the classical 
Ballot theorem first. 

Ballot Theorem: In a ballot, candidate A scores Na votes 
and candidate B scores Nb votes, where Na > Nb- Assume 
that while counting, all the ordering (i.e. all sequences of A's 
and B's) are equally alike, the probability that throughout the 
counting, A is always ahead in the count of votes is Na+Nb ' 
We define Ek to be an event that the buffer becomes empty 
for the first time when the service of packet k is finished. It 
is obvious that all the events Ek , k — 1 , • • • N, are mutually 
exclusive. Then, the event of starvation is the union U]?~J~ Ek- 
This union of events excludes En because the empty buffer 
seen by packet N is not a starvation. When the buffer is empty 
at the end of the service of the k th packet, the number of 
arrivals is k — x\ after the prefetching process. The probability 
of having k — x\ arrivals and k departures is computed from 



a binomial distribution, 



(2k-xi\ k-xi 



. k—a 



p" 



(1 — p) . We next find 
the necessary and sufficient condition of the event Ek- If we 
have a backward time axis that starts from the time point when 
the buffer is empty for the first time, the number of departure 
packets is always more than that of arrival packets. As a result, 
the Ballot Theorem can be applied. For example, among the 
last m events (i.e. m < 2k — xi), the number of packets that 
have been played is always greater than the number of arrivals. 
Otherwise, the empty buffer already happens before the k th 
packet is served. According to the Ballot theorem, the prob- 
ability of event E k is computed by 2 k- Xl ( 2 k-xi)P k ~ Xl 1 k - 
Therefore, the probability of starvation, P s , is the probability 
of the union U^S^E^, given by eq.(fl~|l. 1 
The starvation event may happen for more than once during 
the file transfer. We are particularly interested in the proba- 
bility distribution of starvations, given a finite file size N. 
The maximum number of starvations is J = [^-J where |_-J 
is the floor of a real number. We define path as a complete 
sequence of packet arrivals and departures. The probability of 
a path depends on the number of starvations. We illustrate a 



typical path with j starvations in Figure Q] To carry out the 
analysis, we start from the event that the first starvation takes 
place. Denote by fe; the I th departure of a packet that sees an 
empty queue. We notice that the path can be decomposed into 
three types of mutually exclusive events as follows: 

• Event £(k\): the buffer becoming empty for the first time 
in the entire path. 

« Event Si(ki, fc;+i): the empty buffer after the service of 
packet ki+i given that the previous empty buffer happens 
at the departure of packet hi. 

• Event Uj(kj): the last empty buffer observed after the 
departure of packet kj. 

Obviously, a path with j starvations is composed of a succes- 
sion of events 

£(ki),Si(k 1 ,k 2 ),S 2 (k2,k 3 ), - ■ ■ , 
Sj-2 (fcj-2 , fcj-i), Sj-i (fcj-i , kj), Uj (kj). 

Let Pg( kl ), Ps,(k„k l+1 ) and Pujikj) be the probabilities of 
events £{k\), Si(ki,ki+\) and Uj{kj) respectively. The main 
difficulty to analyze the probability mass function is that the 
media player pauses for xi packets upon starvation. In what 
follows, we analyze the probabilities of these events step by 
step. The event £{k\) can happen after the departure of packet 
fci e [x%,N — 1], According to the proof of Theorem Q] the 
probability distribution of event £(k\) can be expressed as 

if k\ < x\ or k\ = N; 

.^(t-x?)/ 1 ^ 1 ^ 1 otherwise. (2) 

The first starvation cannot happen at the departure of first 
(xi — 1) packets, and cannot happen after all N packets have 
been served. We next solve the probability distribution of 
the event Uj{kj). Suppose that there are j starvations after 
the service of packet kj. The extreme case is that these j 
starvations take place consecutively. Thus, kj should be greater 
than jx\ — 1. Otherwise there cannot have j starvations. If 
kj is no less than N — x%, the media player resumes until 
all the remaining N — kj packets are stored in the buffer. 
Then, starvation will not appear afterwards. In the remaining 
cases, the event Uj(kj) is equivalent to the event that no 
starvation happens after the service of packet kj . We can take 
the complement of starvation probability as the probability 
of no starvation. Hence, the probability distribution of event 
Uj(kj) is given by 



N: 



P, 



0, if kj < jxi or kj 
1, if N - xi < kj < N; 



i-E 



N-kj 



m=xi 2m — xi \ 

otherwise 



2m-x 1 \ m-x x m 
m. if 1 1 



(3) 



Denote by P s (j) the probability of having j starvations. The 
probability P s (0) can be obtained from Theorem Q] directly. 
For the case with one starvation, P s (l) is solved by 



N 



P fl (l) = £P £(i) P Ml(i) =P £ -P 



T 



(4) 



where Pg is the row vector of P^u), and Pu 1 is the row vector 
of P Ml(i) , fari= 1,2,- •• ,7V. 
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Fig. 1. A path with j starvations 



To compute the probability of having more than one star- 
vations, we need to find the probability of event Si(ki,ki+\) 
beforehand. Solving Ps l (ki,ki +1 ) is non-trivial due to that the 
probability of this event depends on the remaining file size 
and the number of starvations. After packet ki is served, the 
I th starvation is observed. It is clear that k\ should not be 
less than lx\ in order to have / starvations. Given that the 
buffer is empty after serving packet fc;, the (I + l) th cannot 
happen at ki + i E [ki + l,ki + x\ — 1]. Since there are 
j starvations in total, the (7 + l)*' 1 starvation must satisfy 
ki + i < N — (j — I — l)x\. We next compute the remaining 
case that the I th and the (I + l) th starvations happen after 
packets k\ and are served. Then, there are (fc;+i — k{) 
departures, and — fc; — x-y) arrivals after the prefetching 
process. According to the Ballot theorem, a path without 
starvation between the departure of packet (fc; + 1) and that 
of packet (fc;+i) is expressed as 2 fc, 1 -2k l -x 1 - Therefore, we 
can express Ps^ktM+i) as 



_ (2k l + 1 ~2k t ~x 1 



2ki + 1 —2ki—x 1 \ k i + 1 —ki~x 

if ki > Ixi, ki + xi < ki + i < N 
0, otherwise 



x l s jpk t+1 -ki-x 1 qk l + 1 -k t 



(j-l-l)x i; (5) 



We denote by P^, the matrix of P s 



i(ki,ki + i) 



for ki , k. 



i,ki+i £ 



[1,7V]. Here, P^, is an upper triangle matrix where all the 
elements in the first (lx\ — 1) rows, and the last x\ rows are 
0. The probability of having j(j > 2) starvations is given by 



EE- E E p < 



£(fci) ■ - r Si(fci,fc 2 ) ' ' ' 



fcl=l k 2 = l 



kj ]_ — 1 kj~l 



PSj-^k^^kj) ■ Pujik^l) 



3-1 

Pe(UP Sl )p^.(6) 



Since the starvation event takes non-negative integer values, 
we can write the probability generating function G(z) by 



G(z) =E{z ] ) 



j 

E 

j=0 



Ps{j)z 3 



3-1 

i=i 



(7) 



In P,P<s, and Vu ■, the binomial distributions can be approx- 
imated by the corresponding Normal distributions with negli- 
gible errors (see Appendix in the technical report [22 1). The 
Gaussian approximation significantly reduces the computa- 
tional complexity of binomial distributions. The approximated 
probability of no starvation computed by the complement 
of eq.© has a complexity O(N) obviously. The probability 
of having only one starvation is a product of two vectors, 
which also yields a complexity O(N). If there are only two 
starvations, we need to compute the product of two vectors 



and one matrix, which has a complexity order 0(N 2 ). When 
j > 3, the computation of P s (j) involves the product of 
two matrices. In general, multiplying two matrices has a 
complexity 0(A^ 3 ) so that the direct computation of eq.(|7]i is 
extremely difficult for large N. Recall that P_s, satisfies i) an 
upper triangle matrix, ii) first lx\ — 1 rows being 0, iii) last X\ 
rows being and iv) P 5; (kuh+i) = P Sl (h + 1, k +1 + 1) if 
they are not zero. These properties facilitate us to compute the 
product of the upper triangle matrices with much less effort. 
Due to the properties i) and iv), the product of two upper 
triangle matrices has a complexity order 0(N 2 ). Detailed 
analysis is provided in the Appendix. When there are j(j > 3) 
starvations, the number of matrix production is j — 2, resulting 
in a complexity order 0{N 2 ^~ 2 ^) for multiplying all the 
matrices. To obtain P s (j), we still need to compute the product 
of the vector Pstki) an d tne matrix. To sum up, the total 
complexity is 0(7V 2 ^ 2 ) for j > 2. 
Asymptotic Property: 

We want to know whether the starvation event yields simple 
implications as the file size N approaches oo. The asymptotic 
behavior of the starvation probability is given by 



lim P s := 

JV-s-oo 



if p < 1; 
otherwise . 



(8) 



The detailed analysis can be found in the Appendix of ll22l . 

The asymptotic analysis reveals that the probability of 
starvation has nothing to do with the start-up threshold when 
p < 1. Under this situation, it is necessary to know how 
frequent the starvation event happens. Here, we compute the 
average time interval between two starvations. Let T s be the 
duration of starvation interval. Its expectation E[T S ] is the 
expected busy period of an M/M/l queue with x% customers 
in the beginning |]4), i.e. 

Xi 



E[T S _ 



(9) 



A(l-p) 

IV. Starvation Analysis Via a Recursive Approach 

In this section, we present a recursive approach to compute 
the starvation probability based on |9|. Compared with the one 
using Ballot theorem, the recursive approach has less compu- 
tational complexity, though without an explicit expression. 

A. Probability of Starvation 

The probability of starvation and the p.g.f can be analyzed 
all in once. However, we compute them separately because the 
analysis of the starvation probability provides an easier route 
to understand this approach. 



We denote by Pi(n) the probability of starvation with a file 
of n packets, given that there are i packets in the system just 
before the arrival epoch of the first packet of this file. In the 
original system, our purpose is to obtain the starvation proba- 
bility of a file with the size N when x\ packets are prefetched 
before the service begins. This corresponds to Pj(n) with 
n = N — x\ and i = X\ — 1. Here, the expression i = X\ — 1 
means that the service starts when the packet X\ sees X\ — 1 
packets accumulated in the buffer. To compute Pi{n), we will 
introduce recursive equations. We define a quantity Qi(k), 
i = 0, 1, • • • , n, < k < i, which is the probability that k 
packets out of i leave the system during an inter-arrival period. 
This probability is equivalent to the probability of k Poisson 
arrivals with rate a during an exponentially distributed period 
with parameter 1/A. According to JH), we obtain 

' , '"' M ™ k 0<k<i-l, (10) 



1 + p' 

(—Y 



pq 



(11) 



To carry out the recursive calculation, we start from the case 
n = 1. 



P(l) = 0, Vi > 1. 



(12) 



When the file size is 1 and the only packet observes a non- 
empty queue, the probability of starvation is obviously. If i 
is 0, the starvation happens for sure, thus yielding 

P (n) = l, Vn. (13) 

For n > 2, we have the following recursive equations: 

i+l 

Pi(n) = J2Qi+i( k ) p i+i-k(n-l), 0<i<N-l. (14) 

We explain (fT4l i as the following. When the first packet of 
the file arrives and sees i packets in the system, the starvation 
does not happen. However, the starvation might happen in the 
service of remaining n — 1 packets. Upon the arrival of the 
next packet, k packets out of i + 1 leave the system with 
probability Qi + i(k). We next add constraints to the recursive 
equation ( TBI for a file of size N. Since the total number of 
packets is N, the starvation probability must satisfy Pi (n) = 
for i + n > N. 

B. P.G.F. of Starvations 

To compute the p.g.f. of starvation, we use the same 
recursive approach, despite of the more complicated structure. 
With certain reuse of notation, we denote by Pi(j, n) the 
probability of j starvation of a file with size n, given that 
the first packet of the file sees i packets in the system upon 
its arrival. Our final purpose is to compute the probability of 
starvation for a file of size N. It can be obtained from P^ (j, n) 
with i = Xi — 1 and n — N — X\. 

In order to compute Pi {j, n) recursively, we provide the 
initial conditions first: 



Pi(j,l) 



Vi = 1,2, ■■ ■ , N- 1, and j > 1; 

1 Vi = 1,2, • • • ,N - 1, and j = 0, 



(15) 



Po(j,l) = 



(16) 



and 

j = or j > 2; 

1 j = 1. 

The equation (TT3T > means that the probability of no starvation 
is 1 conditioned by i > 1 and n = 1, Thus, the probability 
of having one or more starvations is obviously if the only 
packet sees a nonempty system. The equation ( [ToT l reflects that 
the starvation happens for sure when the only packet observes 
an empty queue. However, there can only have one starvation 
event due to n = 1. Another practical constraint is 



P i (j,n) = Q, if i + n>N 



(17) 



because of the finite file size N. 

To compute Pi(j, n), we need to know what will happen if 
the buffer is empty, i.e. i = 0. One intuitive observation is 



P (0,n)=0, Vl<n<Af-ii; 



(18) 



because an empty queue means at least one starvation event. 
For a more general probability Po(j,n), we begin with the 
case j = 1. If only one starvation event exists, there has 



P (l,n) = l, Vl<n<6, 



(19) 



where b := x% — 1 is denoted to be the prefetching threshold. 
If n > b, b packets will be prefetched. Thus, the remaining file 
size is n — b. We see b packets in the system upon the arrival 
of the first packet in the remaining file. Given that the only 
one starvation event has taken place, there will be no future 
starvations. Therefore, the following equality holds, 



P (l,n) = P b (Q,n-b), Vb<n<N-b. 



(20) 



Using the similar method, we can solve Po(j,n) for j > 1. 
However, the property of Po(j, n) with j > 1 is quite different 



P (j, n) = 0, V j > 1 and 1 < n < b. 



(21) 



This means that the probability of having > 1 starvations is 
if the file size is no larger than b. If n is greater than b, then b 
packets are prefetched, leaving n — b packets in the remaining 
file. The remaining n — b packets encounter j — 1 starvations, 
given that the first packet sees b packets in the system upon 
arrival, i.e. 

P (j,n) = P b (j-l,n-b), Vj>landn>6. (22) 

So far, we have computed a critical quantity Po(j, n), the 
probability of meeting an empty buffer. Next, we construct 
recursive equations to compute Pi(j,n) as the following: 

i+l 

p i(j,n) = ^2Qi+i(k)Pi+i-k(j,n - 1), 

k=Q 

i 

= ^pq k P l+1 _ k (j, n - 1) + q' +1 P (j - l,n - 1),(23) 

fc=0 

for < i < N — 1, The eq.d23b contains two parts. The former 
expression reflects the cases that the next arrival sees an non- 
empty queue. The latter one characterizes the transition of the 
system to a prefetching process. 



We are interested in how efficient the recursive method is. 
Hence, we present the roadmap to compute Pi (j, n) and its 
complexity: 

. Step 1: Solving P,(0, 2), for i = 1 to N - 2; 

. Step 2: Solving i^(0, n), for i = 1 to N - 2, and n = 3 

to TV — xi + 1 based on Sf<?/? 7; 
• Step 3: Adding j by 1 and computing Pi(j, n) based on 

Step 1 and Step 2. 

The complexity analysis is carried out from this roadmap. In 
step 1, the computation of Pi(0, 2) incurs up to N summations 
for each i, resulting in at most N 2 sums in total. The Step 2 
compute Pi(0, n) repeatedly for each n and the Step 3 repeats 
Step 1&2 for each j. Therefore, the total complexity has a 
order 0((j + l)N 3 ). 

Remark 1: The complexity orders of the Ballot approach 
with Gaussian approximation and the recursive approach are 
0{N 2 ^ 2 ) for j > 2 and 0((j + 1)N 3 ) respectively. When 
j > 3, the recursive approach may have less computational 
complexity than the Ballot approach. 

V. Fluid Model Analysis of Starvation 
Probability 

So far we have studied the starvation behavior of a single 
file, which is concerned by either the media servers or the 
users. In fact, the media servers are more interested in the QoE 
evaluation scaled to a large quantity of files they supply. They 
cannot afford the effort of configuring each file a different 
start-up delay. In this section, we present a fluid analysis of 
starvation probability, given the distribution of file size. 

In the fluid model, the arrival and departure rates are 
deterministic. We let A be the number of packet arrivals per 
second, and p be the number of departures per second. Here, 
p depends on the encoding rate that the media files use. We 
focus on the setting p > A because no starvation will happen 
with p < A in the fluid model. Let x\ be the start-up threshold. 
The start-up delay T\ is simply computed by x\j\. Once the 
media packets are played, the queue length decreases at a rate 
p — A. The time needed to empty the queue is thus 
Let N p be the total number of packets that are served until a 
starvation happens, 



xi (1 



A 



Xifi 



(24) 



If the size of a file is less than N p , there will be no starvation 
event. 

The distribution of media file size depends on the types 
of contents. A measurement study in |fl9l reveals that the 
music, entertainment, comedy and sports videos have different 
distributions of file size. In this section, we compare the 
starvation probability of several commonly used distributions, 
given the start-up threshold. Note that these distributions 
possess the same mean file size. We further assume that the 
users are homogeneous so that A and p are the same for 
different types of file size distributions. 

i) Exponential distribution: Suppose that the file size N 
follows an exponential distribution with parameter 6. The 



probability of starvation, P, ,, 
P« = Prob (N > N p ] 



is obtained by 

9x\p 



exp(- 
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A' 



(25) 



ii) Pareto distribution: It is frequently adopted to model the 
file size distribution of Internet traffic using TCP protocol. 
Let N m be the minimum possible value of the file size, and 
v be the exponent in the Pareto distribution. The probability 
of starvation is computed by 



P (2) = Prob (N > N p ) = 



■ N m (n-\) y 
1 



VJV m < 



_£l£_. 

otherwise , 



(26) 



where the expectation of the Pareto distribution is equal to that 
of the exponential distribution, i.e. = I. 

iii) Log-Normal distribution: We suppose that the file size 
follows a log-normal distribution \nAf(g, a), where g and a 
are the mean and the standard deviation of a natural normal 
distribution. Given that N v packets can be served without an 

(3) 

interruption, the starvation probability P s ' is computed by 



P^ = p ro b (N > N p ) = \ - ierf [- l0S ^ X ^ 



V2a 



(27) 



where its expectation exp(g+ ^-) equals to ^. 

Equations (|25]),(|26]i and ( |27| i show that the probability of 
starvation can be controled by setting x\, if the distribution of 
file size, the arrival and departure rates are pre-knowledg41 

VI. Application to Streaming-like Service 

This section presents three scenarios in streaming-like ser- 
vice in which our analyses can be utilized to optimize the 
quality of experience. Here, we focus on the M/M/l system. 

The cost of a user reflects the tradeoff between the start- 
up delay and the starvation behaviors (either the starvation 
probability or the continuous playback interval). We first let 
the starvation probability be one of the QoE metrics. Let g(-) 
be a strictly increasing but convex function of the expected 
start-up delay E[Ti\. We denote by Ci(x%) the cost of a user 
watching the media stream, 



C 1 (x 1 ) = P s + 1 g(E(T 1 )), 



(28) 



where 7 is a positive constant. A large 7 represents that the 
users are more sensitive to the start-up delay, and a smaller 7 
means a higher sensitivity to the starvation. Our purpose is to 
find the optimal start-up threshold x\ to minimize C\(x\). 

The choice of C\(xi) should satisfy three basic principles. 
First, it is convex in x\ so that only one optimal threshold 
x\ exists. Second, C\{xi) is bounded even if p is close to 1. 
Otherwise, the configuration of x\ is extremely sensitive to p. 
Third, though x\ is not required to be a decreasing function 
of the arrival rate A, it cannot grow unbounded when A is 
large enough. In what follows, we simply let g(E(T\)) := 
(EiT,)) 2 



• Xl ' 

v A , 



'Because the starvation probabilities Pg*\ P^ and Pg ' take complicated 
forms, we will compare their dependency on 11 numerically in section 
I VIII Both Pareto and Log-normal distributions have two parameters. In the 
comparison, we fix one of them, and solve the other according to the property 
of identical expectations. 



j(3) , 



We apply our models to optimize QoE in three scenarios: 
i) finite media streaming, ii) everlasting media streaming and 
iii) file level. The scenarios i) and ii) are designed for a single 
stream, while iii) is designed for a large number of streams. 
When the streaming file has a finite size, the congested 
bottlenecks such as the 3G base station or the wifi access point 
can configure or suggest a start-up threshold before the media 
stream is played. If the steaming file is large enough (e.g. 
realtime sport channel), a user can measure the arrival/service 
processes, and then configure the rebuffering delay locally. 
In the third scenario, the media server can set up one start- 
up threshold for all the streams that it distributes. To avoid 
malfunctions in realistic scenarios, a user can configure lower 
and upper bounds for the start-up delay. Once the upper bound 
is reached, the media player starts to play regardless of the 
prefetching threshold. 

A. Finite Media Size 

We hereby consider the adaptive buffering technique for a 
stream with finite size. The eq.(Q]) and eq.(l28b yield 



N-l 

C 1 (x 1 )= J2 

k—xi 



2k — Xi 
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- xi 

X\ 
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The starvation probability decreases and the start-up delay 
increases strictly as X\ grows. In the QoE optimization of 
finite media size, there does not exist a simple expression of 
the optimal threshold x*. To find x\ numerically, we need 
to compare the costs using the binary search method. The 
complexity order is low if the binomial distribution in eq.^TJ 
is replaced by the Gaussian distribution. If a user can tolerate 
up to 1 starvations, P s will be replaced by the probability 
(P a (0) + P S {1)) according to eq.©. 

B. Infinite Media Size 

We revisit the user perceived streaming quality in two 
scenarios: 1) p > 1 and 2) p < 1. 

Case 1: p > 1. The starvation probability converges to a fixed 
value when the file size approaches infinity. We adopt the same 
QoE metric as that of the finite media size. Note that P s can be 
directly replaced by its asymptotic value in eq.®. Submitting 
P s to Ci(xi), we have the following cost function 



Ci(xi) = exp 



,zi(l-2p). Xi_ 
-) +7( 
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Letting the derivative be 0, we obtain 



xi ■ exp 



,xi(2p-l). _ (2p- 1)A 2 
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The optimal threshold x\ is solved by 

,(2p-l)A, 2 1 



LambertW (( - 
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(29) 



where LambertW(-) is the Lambert W-function. 
Case 2: p < 1. When p < 1, P s is 1 for an infinite media size. 
If we adopt the QoE metric C\ directly, the optimal start-up 
delay is always 0. This requires a new QoE metric for the 
case p < 1. Since the starvation happens many times, the 
continuous playback interval can serve as a measure of users' 



satisfaction. We denote by C2(x%) the cost function for an 
infinite media size with p < 1, 

C 2 (a;i) := exp(-^— -y) + 7 ( — ) , 

where 6 is a user defined weighting factor to the expected 
playback duration. We differentiate 62(2:1) over x\, and let 
the derivative be 0, then the optimal start-up threshold is 



LambertW { 



A(l-p) 



27(1 - P y 



(30) 



C. Optimal QoE in the File Level 

Unlike the above QoE optimizations, the threshold x\ for 
many files is configured by the media server, instead of the 
users. The objective is still to balance the tradeoff between 
the start-up delay and the starvation probability. Here, only 
the exponentially distributed file size is considered. We choose 
the cost function Ci(xi) that yields Ci(xi) = exp(— ^frf) + 

7 (x) 2 - The optimal threshold x* can be easily found as 



5* = LambertW (( 



p- \' 2 7 j 



p — A 
p6 



(31) 



VII. Numerical Examples 



A. Starvation of M/M/l Queue 

This set of experiments compare the probability of starva- 
tions with the event driven simulations using MATLAB. We 
simulate up to 5000 samples of the M/M/l queue with arrivals 
from files of different sizes. We deliberately consider four 
combinations of parameters: p = 0.95 or 1.1, and x\ = 20 
or 40 pkts. The departure rate p is normalized as 1 if not 
mentioned explicitly. The choice of the start-up thresholds 
coincides with the playout of audio or video streaming services 
in roughly a couple of seconds (e.g. 200^400kbps playback 
rate on average given the packet size of 1460 bytes in TCP). 
The file size in the experiments ranges between 40 and 1000 in 
terms of packets. Figure [2] displays the probability of 0,1, and 
2 starvations with parameters p = 0.95 and X\ = 20. When the 
file size grows, the probability of no starvation decreases. We 
observe that the probabilities of 1 and 2 starvations increase 
first, and then decline after reaching the maximum values. The 
reason lies in that the traffic intensity p is less than 1. Figure 
|2] also shows that our analytical results match the simulation 
well. Figure [3] exhibits the similar results when the start-up 
threshold is 40 pkts. The comparison between figure |2] and 
13 manifests that a larger x% is very effective in reducing 
starvation probability. 

Figure |4] plots the probability of no starvation with the 
traffic intensity p = 1.1. The probability of no starvation is 
improved by more than 10% (e.g. N > 300) when x\ increases 
from 20 to 40. Figure [4] also validates the asymptotic proba- 
bility of no starvation obtained from Gaussian and Riemann 
integral approximations etc. Figure [5] plots the probability 
of one starvation with the same parameters. Recall that the 
probability of one starvation decreases to as N increases in 
the case p = 0.95. While figure [5] exhibits a different trend 
along with the increase of file size. This probability becomes 
saturated, instead of decreasing to 0. When p is greater than 
1, the probability of having a particular number of starvations 



approaches a constant. In both figure [4] and |5J simulation 
results validate the correctness of our analysis. Hence, in the 
following experiments, we only illustrate the analytical results. 

B. Starvation in the File Level 

This set of numerical experiments show the relationship 
between the starvation probability and the distribution of file 
size. The traffic intensity p is set to 0.95. Let be 1/2000 
in the exponential distribution. Then, the average file size is 
2000 pkts. For the Pare to distribution, we set the minimum 
file size to be 300 pkts so that the exponent v is 1.1765. The 
parameters g and a of the Log-normal distribution are set to 
5.0 and 2.2807. We plot the CDF curves of the file size and 
the starvation probabilities in figure [6] The left-side subfigure 
illustrates the distribution of file size with the parameters 
configured above. The Pareto and the Log-normal distributions 
exhibit heave-tail property. In the right-side subfigure, we plot 
the starvation probability of different file distributions when 
x\ increases from 10 to 150. The starvation probability of 
the Pareto distribution is very high with small x\. This is 
because the files have a minimum size (i.e. N„ < N m ). 
The log-normal distribution demonstrates a small starvation 
probability. In addition, increasing the threshold X\ does not 
having a significant impact on the starvation probability when 
x\ is greater than 90. Therefore, as the take-home message of 
fluid analysis, the configuration of x\ relies on the distribution 
of file size to a great extent. To obtain a better QoE, the media 
servers can set different x\ for different classes of media files. 

C. QoE Optimization in the File Level 

We investigate the cost minimization problem at the media 
server side numerically. Let fi := 25 which means that 25 
packets are served per second. Given the packet size of 1460 
bytes, this service rate is equivalent to 292Kbps (without 
considering protocol overheads). Let the mean file size 1/8 be 
1000 and 2000 packets respectively (equivalent to the playback 
time of 40 and 80 seconds). The sensitivity 7 is set to 0.01 
or 0.005. Figure [7] illustrates the choice of the optimal start- 
up thresholds when A increases from 20 to 25 (i.e. p < 1). 
We evaluate four combinations of 9 and 7 numerically. Our 
observations are summarized as follows. First, for the same file 
size distribution, a smaller 7 causes a higher optimal start-up 
threshold. Second, x\ is not a strictly decreasing function of 
A. When A is small (e.g. 20pkts/s), a large start-up threshold 
does not help much in reducing the starvation probability, but 
causes impatience of users of waiting the end of prefetching. 
If A increases, the adverse impact of setting a larger x\ on the 
start-up delay can be compensated by the gain in the reduction 
of starvation probability. Third, with the same sensitivity 7, the 
optimal x\ of a long video stream can be smaller than that 
of a short one in some situations. This is caused by the fact 
that the large threshold might not significantly improve the 
starvation probability for a file of large size. 

VIII. Conclusion, Discussion and Future Work 

We have conducted an exact analysis of the starvation 
behavior in Markovian queues with a finite number of packet 
arrivals. We perform a packet level analysis and a fluid 



level analysis. The packet level study is carried out via two 
approaches, the Ballot theorem and the recursive equations. 
Both of them have pros and cons; the former providing an 
explicit expression, but with high complexity order in general, 
while the latter is more computationally efficient, but without 
an explicit result. In order to analyze the behavior from a 
media service provider's point of view, we perform a fluid level 
analysis that computes the probability of starvation among 
many files. We further apply the theoretical results to perform 
QoE optimization for media streaming services. Our work 
can be extended to study the QoE metrics in a more general 
network with multiple bottlenecks between the server and the 
user. In this situation, the arrival process can be modeled as a 
phase-type renewal process. 

In terms of future works, we aim at extending the analytical 
methods to perform QoE optimization in adaptive streaming 
services. Another important extension is the starvation analysis 
in a wireless environment where the wireless link is shared by 
multiple connections. In such a case, the arrival rate to a user 
is time varying due to the arrivals and departures of other calls. 
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Appendix 

A. Complexity Analysis of (O 

We focus on the cases with more than two starvations (j > 
2). Recall that P$ [ satisfies i) an upper triangle matrix, ii) 
first lx\ — 1 rows being 0, iii) last x x rows being and iv) 
Ps, {h, = Ps ; (ki + 1, ki + i + 1) if they are not zero. For 
ease of understanding, we only give an example with N = 8 
and j = 3. The method can be extended to any N and j. 
Given the above parameters, there have 
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where ai, bi are the variables to denote the probabilities in a 
simple way. 

In order to obtain the probability of having 3 starvations, 
we need to compute Ps 1 x P5 2 first, Ps x x P^ 2 = 
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Here, it is observed that the third row is obtained if we shift 
the second row to the right by 1 digit. Thus, we only need 
to multiply the second row of with the matrix Vg 2 ■ The 
product is also an upper triangle matrix, where the elements 
exhibit the same structure as those of Ps 2 . The complexity 
order is thus upper bounded by 0(N 2 ). Given that there are 
j(> 2) starvations, the complexity order of matrix product 
is 0{N 2 ^ J ^). Combined with the products of P e , the total 
complexity has the order 0(N 2 ^ 2 ). 



